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ABSTRACT 


The  MIRTE  computer  program,  which  provides  estimates  of  item  parameters 
and  individuals'  prof iciencies  (abilities)  based  on  the  multidimensional  two- 
parameter  logistic  (M2PL)  item  response  theory  model,  is  described.  The 
program  uses  a  modified  Newton-Raphson  algorithm  to  iteratively  estimate  the 
parameters  and  proficiencies.  The  algorithm,  use  of  the  program,  and  some 
results  based  on  simulated  datasets  are  described. 
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Chapter  1 


INTRODUCTION 

The  MIRTE  computer  program  provides  estimates  of  item  parameters  and 
individuals'  proficiencies  (abilities)  for  the  model  discussed  by  McKinley  & 
Reckase  (1983)  and  Reckase  (1985).  The  method  of  estimation  is  a  variation  of 
the  joint  maximum  likelihood  procedure  using  a  modified  Newton-Raphson  itera¬ 
tive  technique.  This  report  contains  a  brief  overview  of  the  model  and  the 
likelihood  function,  a  description  of  the  algorithm,  a  description  of  the 
input  and  output,  and  some  data  on  performance  of  the  program. 

The  Model  and  the  Likelihood  Function 


The  model  underlying  the  program  is  the  multidimensional  extension  of  the 
two-parameter  logistic  (M2PL)  model  described  by  McKinley  &  Reckase  (1983)  and 
Reckase  (1985): 

f .  .  f .  . 

P. .  =  P(x. .  =  l|a.,  d.,  0.)  =  c.  ♦  (1  -  c.)  e  1J/(1  +  e  1J);  (1) 

-ij  - ij  '  i’  -i’  j  -l  -l 

I 

f • •  =  a.  0.  +  d.  (i  =  1,  2,  ...»  K;  j  =  1,  2,  ...,  N). 

-ij  l  j  -i  -  J  - 


where: 


P.  . 
-I J 

x.  . 
-ij 


-i 


0.  = 
J 

N 


the  probability  of  a  correct  response  to  item  i  by  individual  j; 
the  response  (1  =  correct,  0  =  incorrect)  of  individual  j 
on  item  i; 

a  vector  of  M  discrimination  parameters  for  item  i; 
a  parameter  related  to  the  difficulty  of  item  i; 
a  f ixed  constant  which  may  vary  from  item  to  item.  It  is  the 
lower  asymptote  of  the  item  response  surface; 
a  vector  of  M  proficiency  (ability)  parameters  for  individual  j; 
the  number  of  individuals; 


K  =  the  number  of  items; 

M  =  the  number  of  proficiency  dimensions. 

Note  that  c^  is  a  fixed  constant  rather  than  a  parameter  to  be  estimated.  The 
user  of  the  program  must  specify  the  values  of  c^,  which  may  be  the  same  for  each 
item.  The  model  is  sometimes  referred  to  as  the  compensatory  model  because  it 
allows  high  proficiency  on  one  dimension  to  compensate  for  low  proficiency  on 
other  dimensions  in  arriving  at  a  correct  response  to  a  test  item. 

It  is  assumed  that  the  response  to  each  item,  conditional  on  the  profi¬ 
ciency  vector,  is  independent  of  that  to  every  other  item.  Hence,  the  likeli¬ 
hood  of  each  K-element  response  vector  xj  can  be  expressed  as  a  product  of 
probabilities : 


n  p. .  1Jo.  . 

i*i  "1J  1J 


l-x.  - 
-ij 


where : 


Q.  .  =  1  -  p.  . 

-ij 


Assuming  individuals  respond  to  the  items  independently  of  one  another, 
the  likelihood  of  a  set  of  N  response  vectors  is  also  a  product  of  probabili¬ 
ties: 


L  = 


N  K 

n  ii 


j=i  i=i 


l-x.  . 
-1J 


(2) 


Maximum  Likelihood  (ML)  estimates  of  the  parameters  of  the  model  are 
those  values  that  maximize  the  likelihood  function,  L.  Since  it  is  easier  to 
work  with,  and  since  its  maximum  occurs  for  the  same  values  as  L,  we  usually 
maximize  the  natural  logarithm  of  L.  Equivalently,  we  may  define  the  ML 


estimates  as  the  values: 


that  minimize  the  negative  of  the  logarithm  of  L: 


F  =  -Ln(L) 


(4) 


The  Algorithm 


The  Basic  Procedure 


Finding  estimates,  (3),  that  minimize  F  in  (4)  involves  finding  the 
partial  derivative  of  F  with  respect  to  each  parameter  in  (1)  and  solving  the 
equations  resulting  from  setting  the  partial  derivatives  to  zero.  The  matrix 
of  second  partial  derivatives  of  F  with  respect  to  each  pair  of  parameters 
must  be  positive  definite  to  ensure  a  minimum  is  found.  The  equations  to  be 
solved  are  nonlinear  and  no  direct  solution  is  available,  so  an  iterative 
procedure  must  be  used  to  derive  a  series  of  successive  approximations  to  the 
solutions.  The  iterative  Newton-Raphson  procedure  for  minimization  consists 
of  solving  for  a  vector  of  unknowns,  w,  by  employing  a  set  of  initial  esti¬ 
mates,  Wq,  and  updating  to  achieve  a  better  set  of  estimates: 


*1  '  "o  ■  “olgo 


(5) 


where  gg  (the  gradient)  is  the  vector  of  first  partial  derivatives  evaluated 
at  the  values  in  w^,  and  (the  Hessian)  the  matrix  of  the  second  partial 


derivatives  similarly  evaluated.  Letting  Fn  be  the  value  of  F  evaluated 
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at  Wg  and  F^  that  evaluated  at  w^ ,  the  difference  (a  positive  number) 

is  a  measure  of  the  improvement  of  over  w^.  A  second  approximation,  w^ ,  is 
made  by  substituting  w^  for  w^,  evaluating  and  H^,  and  calculating  as  in 
(5).  The  series  of  successive  approximations  is  continued  until  the  change  in 
the  evaluated  value  of  F  between  successive  stages  falls  below  some  small 
criterion  value  (converges).  Expressions  for  the  partial  derivatives  and 
second  derivatives  are  provided  in  Appendix  A.  The  joint  maximum  likelihood 
procedure  as  usually  applied  to  item  response  theory  (IRT)  estimation  problems 
(Wingersky,  1983;  Hambleton  &  Swaminathan,  1985)  consists  of  two  parts:  a  set 
of  iterations  in  which  the  current  proficiency  estimates  are  held  constant 
(fixed)  while  iterations  are  performed  on  the  item  parameter  estimates;  and  a 
set  of  iterations  in  which  the  current  item  parameter  estimates  are  held  fixed 
while  iterations  are  performed  on  the  individuals'  proficiency  estimates.  In 
the  algorithm  used  by  the  MIRTE  program,  a  set  of  iterations  is  referred  to  as 
a  phase.  All  phases  consisting  of  iterations  on  proficiency  estimates  with 
fixed  item  parameters  are  identical.  In  estimating  item  parameters,  however, 
there  are  two  different  types  of  iterations.  In  some  phases  the  a-parameters 
are  held  fixed  and  iterations  are  performed  only  on  the  d-parameters .  In 
other  phases  all  item  parameters  are  estimated.  The  MIRTE  estimation  algo¬ 
rithm  combines  several  phases  into  a  step  and  there  are  two  types  of  steps 
between  which  it  alternates.  These  will  be  referred  to  as  "odd-numbered"  and 
"even-numbered"  steps.  The  following  three  sections  describe  the  method  of 
providing  initial  estimates  (analogous  to  w^)  in  (5),  and  the  nature  of  rhe 
phases  in  the  even-numbered  and  the  odd-numbered  steps.  This  description 
assumes  that  both  item  parameters  and  subjects'  proficiencies  are  to  be 
estimated.  The  program  also  allows  the  estimation  of  item  parameters  holding 
proficiencies  fixed  in  all  phases,  or  proficiencies  with  item  parameters  fixed 
in  all  phases. 


t 

A.V 


Initial  Estimates 


Before  estimation  begins,  the  program  eliminates  the  data  for  any  cases 
(persons)  having  perfect  or  zero  number-right  scores.  These  cases  are  identi¬ 
fied  in  the  output  from  the  program.  In  order  to  commence  iterations,  it  is 
necessary  to  have  initial  estimates  of  the  proficiencies  and  the  item  parame¬ 
ters.  The  user  must  supply  initial  estimates  of  the  discrimination  parame¬ 
ters,  .  These  can  be  any  number  in  the  range 

0  <  a.,  <  a 

-iko  -max 

where  a..  is  the  kth  element  of  a.  and  a  is  a  user  definable  maximum  value 
-iko  x  -max 

for  these  discrimination  parameters  (the  default  value  is  3.5).  If  all  of  the 
a£^0  are  started  at  zero  for  an  item  the  algorithm  will  encounter  problems 
because  all  the  partial  derivatives  with  respect  to  the  9's  will  be  evaluated 
to  zero  (see  Appendix  A).  It  is  possible  to  set  some  a^0  to  zero  but  it  is 
probably  better  to  choose  nonzero  starting  values. 

The  initial  difficulty  parameters  may,  optionally,  be  supplied  by  the 
user  of  the  program.  It  has  been  found,  however,  that  the  following  formulas 
provide  good  initial  d-values  and  the  program,  by  default,  computes  these 
"starting  values": 

d.  =  Ln  (z./(l  -  z .  ) } 

—  in  L  —  i  —  i  1 


TVC  V.  V  V  V  *V*  NT.  Jtr.  f-a, 


z .  =  n  x .  .  /n 

_1  j=rlJ  - 


In  order  to  avoid  computational  problems,  the  quantity  in  braces  for  these 

initial  difficulty  estimates  is  constrained  to  the  open  interval  (0.0001, 

.9999).  The  d.  are  also  transformed  to  a  mean  of  zero  and  standard  deviation 
-10 

of  2  before  commencing  iterations.  Initial  values  for  the  proficiency  esti¬ 
mates  are  first  computed  as 


r>  ~ 

9  .  =  }  a.  x.  . 

-jko  -iko  -ij 


These  values  are  then  either  orthonormalized  using  the  Gram-Schmidt  procedure 
or  scaled  to  zero  mean  and  unit  variance.  Orthono.malization  is  a  user- 
selectable  option  and  the  default  is  to  rescale  to  zero  mean  and  unit  vari- 


As  was  mentioned  above,  the  c^  are  fixed  cons  .ants  rather  than  parameters 
to  be  estimated.  The  user  of  MIRTE  must  supply  the  values  of  these  constants 
as  input  to  the  program.  The  c^  may  be  specified  to  be  the  same  for  all  items 
and  the  common  value  may  be  specified  as  zero. 


Odd  Numbered  Steps 


For  item  parameter  estimation  phases  within  each  odd-numbered  step,  the 
current  estimates  of  the  proficiencies  are  held  fixed  while  iterations  are 
performed  on  the  d-parameter  estimates.  As  mentioned  above,  all  item  parame¬ 
ters  are  held  fixed  in  proficiency  estimation  phases.  Hence  an  odd-numbered 
step  proceeds  as  follows: 


iW 


„*»  i,*  - 
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Phase  1:  hoLd  a.  and  d.  at  current  values;  iterate  on  0., 

i  -l  j’ 


Phase  2:  hold  a.  and  0.  at  current  values;  iterate  on  d. . 

l  j  -i 

Additional  phases  are  computed,  with  odd-numbered  phases  identical  to  phase  1 
in  form,  and  even-numbered  phases  identical  to  phase  2.  Within  each  phase, 
iterations  are  performed  independently  on  each  individual  (for  proficiency 
estimation)  or  item  (for  item  parameter  estimation)  because  both  items  and 
individuals  have  likelihood  equations  (from  setting  the  first  derivatives  to 
zero)  that  are  independent  of  other  individual's  or  item's  equations. 

Iterations  proceed  within  each  phase  until  either: 

1.  Convergence  is  reached;  that  is,  all  parameters  being  estimated 
change  less  than  a  user-specifiable  criterion  value  for  itera¬ 
tions  (default  =  .05);  or, 

2.  A  user-specifiable  maximum  number  of  iterations  is  reached 
(default  =  16). 

Phases  continue  within  each  step  until  either: 

1.  -u  <  change  in  F  between  two  successive  phases  <  u,  where  u  is 
a  user-definable  constant  (default  value  is  5.0);  or, 

2.  change  in  F  between  two  successive  phases  <  -u. 


Even-numbered  Steps 

For  item  parameter  estimation  phases  within  each  even-numbered  step,  the 
current  estimates  of  the  proficiencies  are  held  fixed  while  iterations  are 
performed  on  all  the  item  parameter  estimates.  Iterations  proceed  on  the  item 
parameter  estimates  until  convergence  is  reached  or  a  maximum  number  of 


k>  t.t  i.1 u  ^ 


iterations  has  been  carried  out.  The  criteria  are  the  same  as  for  odd-num¬ 
bered  steps,  as  are  the  defaults  (less  than  .05  change  in  all  estimates  or  16 
iterations).  Proficiency  estimation  phases,  as  is  always  the  case,  involve 
holding  all  item  parameter  estimates  fixed.  Phases  continue  to  be  computed  as 
in  the  odd-numbered  steps. 

There  is  an  option  in  the  program  to  begin  by  estimating  all  item  parame¬ 
ters,  including  the  a-parameters ,  in  step  1. 


Convergence  of  Steps 


Within  each  step,  several  phases  are  computed  until  a  convergence  criter¬ 
ion  for  steps  is  reached.  This  criterion  is  a  specified  amount  of  change  in 
the  computed  value  of  F  (the  negative  log  likelihood  function)  between  succes¬ 
sive  phases,  as  mentioned  above.  The  criterion  amount  is  user-selectable. 

The  default  is  5.0.  As  mentioned  above,  the  likelihood  function  is  evaluated 
initially  (Fq)  and  at  each  phase  (Fp  £2 ,  F^,  ...).  At  phase  1  the  change  is 
Fq  -  F^.  The  change  in  F  between  phases  should  always  be  a  positive  number. 
Occasionally  a  small  negative  value  can  occur.  If  a  negative  change  of  less 
than  the  criterion  amount  occurs,  the  program  proceeds  as  usual.  Occasionally 
a  larger  negative  change  may  occur.  This  appears  to  be  the  result  of  attempt¬ 
ing  to  use  the  program  with  too  few  items  or  too  few  cases  (individuals),  with 
the  result  that  too  many  estimates  are  set  to  constrained  extremes.  Item 
response  data  generated  from  models  other  than  the  M2PL  model  have  also 
resulted  in  negative  changes  in  F,  especially  data  from  a  three-parameter 
model.  When  the  program  detects  a  negative  change  (increase  in  F  of  more  than 
the  criterion)  between  phases,  it  stops  computing  additional  phases  in  that 
step.  Rather,  it  proceeds  to  the  next  step.  If  there  are  two  consecutive 


5 

# 


vr» 


negative  changes  the  program  stops  executing  and  outputs  results  from  the  last 


step  having  a  positive  or  zero  change.  At  phase  2,  the  change  is  Fj  -  F^  at 
phase  3,  F^  -  F^,  etc.  If  this  value  is  lower  than  the  criterion  for  two 


successive  phases,  the  step  is  declared  converged  and  the  program  proceeds  to 


the  next  step. 


Numbers  of  Steps  and  Phases 


The  number  of  steps  and  maximum  number  of  phases  to  be  performed  can  be 


specified  by  the  user.  The  defaults  are  currently  four  steps  and  60  phases. 


It  should  be  noted  that  phases  are  numbered  overall  rather  than  within 


steps.  Hence,  the  default  is  a  total  of  60  phases,  not  60  phases  per  step. 


The  number  of  phases  is  usually  less  than  25,  but  may  be  higher  with  larger 


datasets.  Increasing  the  maximum  allowed  a-parameter  estimate  will  tend  to 


increase  the  number  of  steps  but  may  give  a  better  solution  (smaller  value  of 


The  program  continues  until  the  maximum  number  of  steps  or  phases  is 


reached,  or  negative  changes  in  F  greater  than  the  criterion  occur  for  two 


consecutive  phases.  In  general,  it  has  been  found  that  four  steps  are 


sufficient  for  overall  convergence  and  rarely  will  using  more  than  four 


provide  a  better  solution. 


Scaling  and  Constraining  the  Estimates 


Because  of  an  indeterminancy  in  the  model,  it  is  necessary  to  scale  the 


estimates  of  the  parameters.  It  is  readily  apparent  in  the  expression  for  f- 
in  (I)  that  multiplying  each  element  of  by  a  constant,  and  multiplying  the 


corresponding  element  of  0^  by  the  reciprocal  of  that  constant  leaves  the 


value  unchanged.  Hence  an  infinite  number  of  sets  of  estimates  can  result  in 


the  same  value  of  1°  order  to  circumvent  this  indeterminancy,  which  is 


common  to  all  IRT  estimation  algorithms,  the  proficiency  estimates  for  each 


dimension  are  scaled  to  zero  mean  and  unit  variance  after  each  step  in  which 


they  are  estimated.  It  is  also  necessary  to  rescale  the  item  parameter 


estimates  so  that  the  f—  and  F  remain  constant. 


If  0^  is  rescaled  to,  say  (where  a  bar  over  an  estimate  represents  the 


mean  estimate  and  S  represents  the  standard  deviation  cf  the  estimates), 


0.-0 
e:  =  tj? 


(m  =  1,  2,...,  M) 


while  a.  is  rescaled  to 

l 


a.  =  S'  a. 
-lm  -0m  -lm 


(m  =  1,  2...,  M) 


and  d^  to 


=  d.  +  a . .  0 .  +  a.  0  +  ...  +  a.  0 

-l  -ll-l  -i2-2  -lM  M 


then  it  can  be  seen  that 


r-  **  r  - 

)  a .  0  .  +  d .  =  )  a .  0 .  +  d , 

^,-im-jm  -l  ^,-im-jm  -l 

m=l  J 


so  that  f—  will  remain  the  same  after  the  rescaling.  Hence  (7)  and  (8) 


provide  the  formulas  by  which  the  discrimination  and  difficulty  parameter 


estimates  are  rescaled  after  rescaling  the  proficiency  estimates. 


■To. 


m 


& 


m 


•a 


As  is  done  in  other  IRT  estimation  algorithms  such  as  LOGIST  (Wingersky, 
Barton,  &  Lord,  1982),  it  is  necessary  to  constrain  the  estimates  at  each  stage 
in  the  MIRTE  estimation  program  to  prevent  them  from  drifting  to  unreasonably 
large  or  small  values.  The  user  may  specify  maximum  and  minimum  values  of  the 
proficiency  estimates.  The  minimum  (maximum)  value  used  by  the  program  for 
the  difficulty  estimates  is  the  minimum  (maximum)  value  for  the  theta  esti¬ 
mates.  As  each  of  these  parameters  is  re-estimated  at  each  iteration,  if  it 
becomes  higher  (lower)  than  the  limit,  it  is  set  to  the  limit.  The  program 
defaults  are  -4.5  and  +4.5  for  the  theta  estimates  and  hence  also  for  the  d- 
parameter  estimates.  Since  negative  discrimination  parameters  imply  that  a 
lower  probability  of  getting  an  item  correct  is  associated  with  higher  profi¬ 
ciency,  which  would  be  counter  to  the  IRT  assumptions,  the  a-parameter  esti¬ 
mates  are  constrained  to  a  lower  bound  of  zero.  The  actual  lower  bound  is  .01 
to  prevent  all  a-parameters  becoming  zero  for  an  item,  which  would  result  in  a 
totally  nondiscriminating  item.  An  upper  bound  can  be  specified  by  the  user 
and  the  default  value  in  the  program  is  3.5.  Thus,  if  at  any  iteration  a 
discrimination  parameter  estimate  is  zero  or  negative,  it  is  set  to  .01,  and 
if  it  exceeds  the  upper  limit,  it  is  set  to  that  limit.  Limits  are  set  on  all 
estimates  before  they  are  rescaled.  Hence,  the  rescaled  estimates  for  values 
set  to  limits  may  not  equal  the  limits  chosen  by  the  user. 

As  estimates  are  rescaled  after  each  phase  in  which  proficiencies  are 
estimated  they  are  again  compared  to  the  upper  and  lower  bounds  and  con¬ 
strained  to  stay  within  these  bounds.  This  constraint  usually  results  in  a 
slight  change  in  the  computed  value  of  F.  For  the  user's  information  F  is 
output  both  before  and  after  rescaling. 

The  program  always  indicates  with  the  output  of  each  estimate  if  it: 
a)  failed  to  converge,  b)  was  set  to  a  limit,  or,  c)  both  failed  to  converge 


and  was  set  to  a  limit. 


Estimates  of  Standard  Errors 


Asymptotic  variances  and  covariances  of  the  estimated  parameters  can  be 
estimated  by  taking  the  inverse  of  the  matrix  of  second  partial  derivatives 
(used  in  the  iterative  estimation)  evaluated  at  the  last  iteration.  As 


pointed  out  by  Hambleton  and  Swaminathan  (1985),  these  estimates  are  approxi¬ 


mations  because  the  true  values  of  the  proficiencies  are  required  to  compute 
variances  of  the  item  parameter  estimates  and  vice  versa.  The  MIRTE  program 
computes  the  square  roots  of  the  variances  of  the  estimates  to  yield  estimates 
of  the  standard  errors  of  all  of  the  parameters.  It  may  be  seen  from  (6)  and 
(7)  that  the  estimates  of  the  standard  errors  of  the  9s  and  as  must  be 
rescaled  each  time  the  parameter  estimates  are  rescaled.  This  is  done  by  the 
program. 


Estimates  of  Multidimensional  Item  Parameters 


m 


When  a  final  solution  is  attained,  the  multidimensional  item  parameters 
derived  by  Reckase  (1985,  1986)  are  estimated  and  printed  out.  These  parame¬ 
ters  are: 


R 

4 
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1.  Multidimensional  Difficulty 


Reckase  (1985)  defined  this  parameter  for  item  i  as 


D.  =  -  d./(  l  a.  2)-1. 
-l  -l  v  L,-nn  ' 
m=l 
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This  parameter  is  the  distance  along  a  line  perpendicular  to  the  equiprobable 
contours  of  the  item  response  surface  from  the  origin  of  the  space  to  the  (1.0 
♦  c^)/2  contour.  The  line  is  at  an  angle  of  to  the  kth  proficiency 
dimension  where 


cos  a., 
-lk 
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2.  Multidimensional  Discrimination 


(9) 


Reckase  (1986)  defined  this  parameter  for  item  i  as 


MDISC  =  (  Y  a.  2] 
v  L  -lm  ’ 


m=l 


It  is  related  to  the  item  characteristic  curve  on  the  multidimensional  item 
response  surface  above  the  line  defining  D  and  a  vector  of  angles,  a.  More 
specifically  it  is  proportional  to  the  slope  of  that  curve  at  the  point  of 
steepest  slope  and  is  thus  analogous  to  the  unidimensional  discrimination 
parameter. 

In  the  MIRTE  program  we  denote  the  multidimensional  discrimination 
parameter  as 


y.  =  (  l  a.  =  (a.'a.f 
J-i  v  L.-im  '  K  \ 
m=l 


(10) 


and  the  multidimensional  difficulty  parameter  as 


Denoting  6^  as  a  vector  of  the  cosines  of  the  angles  in  (9) 


cos  a . , 

-l  1 

6.  =  cos  a . „ 
l  "i2 


cos  a.M 


it  may  be  seen  from  (9)  that 


a.  =  Y- 6 ■ 

l  -it 


so  that,  using  (11)  and  (12)  we  may  write  f—  in  (1)  as 


f.  •  =  Y-(«-  0.  -  6- ) 

-ij  -i  i  j  -i 


Noting  that  the  inner  product  6^  0^  is  a  scalar  we  can  replace  it  by, 

*  , 
say,  9„  to  write  the  exponent  in  model  (1)  as 


f.  .  =  2.(0.  .  -  6. ) 

-ij  -Li  -ij  -i 


This  last  expression  is  the  exponent  in  representing  the  multidimensional 

parameters  for  item  i  according  to  the  unidimensional  item  characteristic 

.  * 

curve  referred  to  above.  It  must  be  emphasized,  however,  that  0. .  varies  from 

-ij 

item  to  item  since  the  angles  whose  cosines  are  given  is  6^  vary.  If  they  do 
not  vary  we  have  a  truly  unidimensional  proficiency  space. 
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The  MIRTE  computer  program  outputs  estimates  of  y^,  8*  and  the  a^.,  com¬ 
puted  using  (9),  (10),  and  (11)  with  estimates  replacing  the  a^  and  d^. 


Analysis  of  Residuals 

For  the  final  solution  the  program  computes  an  estimate  of  P^j  by  substi¬ 
tuting  estimates  of  a^ ,  d^ ,  and  0^  into  (1).  It  th':n  computes  residuals,  r^j 

=  x.  .  -  P.  .  ,  for  each  individual  on  each  item.  The  variance  of  the  residuals 
-ij  -iJ 

for  each  item,  and  covariances  between  all  pairs  of  items  are  also  computed. 
The  user  may  choose  to  have  the  values  of  these  variances  and  covariances 
output.  The  covariances  involving  each  item  are  ordered  from  highest  to 
lowest  before  being  output.  Covariances  between  the  residuals  of  each  item 
and  the  estimated  proficiencies  on  each  dimension  are  also  computed  when  this 
option  is  selected.  The  program  always  outputs  a  summary  of  the  distribution 
of  residual  covariances. 


Performance  of  the  Program 


The  program  was  written  in  ANSI  standard  Fortran  using  the  Ryan  McFarland 
Fortran  Compiler  for  the  IBM  PC  and  compatibles.  Both  interactive  and  batch 
versions  have  been  created  for  these  computers.  A  batch  version  has  also  been 
created  and  run  on  an  IBM  mainframe.  All  of  the  important  computations  are 
done  in  double  precision. 

In  order  to  evalue  the  MIRTE  program,  a  number  of  simulated  datasets  have 


been  generated  and  analyzed.  Simulated  item  parameters  are  generated  for  each 


tern  by: 


1.  Generating  a  pseudo-random  angle,  a^,  from  a  uniform  distribution  on 


the  interval  (0,  tt / 2  ) ; 


*5$ 

$ 


$ 


sis 


$ 

•Kv 


k 


3 

I 

tib 

m 

I 

yKi 

rm 


$ 

& 


'  V  1 

vjv 


i  ft  H  *  t  *  *'»  ft** 


,fc  |  g  a  g.j  i  .*4  ft* ’k’**'1  *?■ 


i‘i,< * |.if  J*1 


2.  Generating  a  pseudo-random  multidimensional  difficulty,  8. ,  from  a 
normal  distribution  with  mean  zero  and  standard  deviation  1.0; 

3.  Generating  a  pseudo-random  multidimensional  discrimination,  y-»  from 
a  normal  distribution  with  mean  1.7  and  standard  deviation  .2;  and 

4.  Computing  a^  and  d^  using  (9),  (10),  and  (11). 

5.  If  nonzero  values  of  c^  are  specified  they  are  incoi.  porated  into  the 
generation  process. 

The  simulated  proficiencies  are  generated  as  pseudo-random  variables  from 

a  bivariate  normal  distribution  with  specified  correlation  (varying  from 

dataset  to  dataset)  and  means  of  zero  and  standard  deviations  of  one. 

Finally,  for  each  simulated  subject  on  each  simulated  item,  P^j  is  computed 

from  (1),  and  compared  to  a  pseudo-random  variable,  R^j,  generated  from  a 

uniform  distribution  on  the  interval  (0,  1).  If  R- •  <  P. .  then  x. .  is  set  to 

~ij  -ij  -ij 

1,  otherwise  it  is  set  to  zero.  This  results  in  an  N  by  K  matrix  of  data  to 
be  analyzed  by  MIRTE.  In  analyzing  these  datasets  the  starting  values  for  the 
iterations  on  the  a-parameters  are  generated  using  steps  1  through  4,  above. 

The  program  appears  to  be  sensitive  to  the  distribution  of  the  discrimi¬ 
nation  parameters  in  the  generated  data.  When  data  were  generated  with  6  hav¬ 
ing  a  standard  deviation  of  .7,  and  y  having  a  mean  of  1.2  and  standard 
deviation  of  .2,  the  program  did  not  converge  and  the  estimates  of  a-parame¬ 
ters  that  were  printed  out  did  not  correlate  with  the  generating  parameters. 
The  proficiency  and  d-parameter  estimates  did  not  correlate  as  highly  with  the 
generating  values  as  in  other  datasets  but  they  were  better  than  the  a-parame- 
ter  estimates. 

To  date,  16  datasets  have  been  analyzed  with  constant  c.  Five  of  these 
had  2000  subjects  and  60  items,  one  had  2000  subjects  and  104  items,  five  had 
500  subjects  and  50  items,  and  five  had  200  subjects  and  30  items.  Datasets 
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were  generated  with  correlations  of  0,  .3,  .5,  or  .7  between  the  two  profi¬ 
ciency  dimensions.  Means  and  standard  deviations  of  estimates  have  been 

4 

compared  to  those  of  the  generating  parameters,  and  correlations  between  the 
estimates  and  parameters  have  been  computed.  In  general,  the  results,  summar¬ 
ized  in  Table  1,  are  excellent  for  the  large  (N  =  2000,  K  =  60  or  104) 
datasets,  and  quite  good  for  smaller  ones  (N  =  500,  K  =  50  and  N  =  200,  K  = 

30).  Correlations  between  the  two  estimated  proficiency  dimensions,  however, 
tend  to  be  smalLer  than  the  correlations  between  the  generating  proficien¬ 
cies,  The  d-parameters  are  estimated  very  well  with  sample  sizes  as  low  as 
500  and  tests  of  50  items,  provided  that  the  correlation  between  the  generat¬ 
ing  proficiencies  is  .3  or  less.  I_t  not  recommended  that  datasets  smaller 
than  this  be  analyzed  with  MIRTE  even  though  good  estimates  of  the  d-parame- 
ters  may  be  obtained. 

One  datasec  of  each  size  was  generated  from  a  model  with  a  lower  asymp¬ 
tote,  c,  of  .2  and  analyzed  specifying  all  c^  to  be  zero.  These  datasets,  as 
might  be  expected,  exhibited  difficulty  in  converging  and  resulted  in  very 
poor  estimates  of  the  a-parameters .  The  estimates  of  the  d-parameters  and 
proficiencies  were,  however,  surprisingly  good  in  the  large  datasets. 

Two  additional  datasets  having  nonzero  lower  asymptotes  for  the  item 
response  surfaces  were  also  examined,  as  shown  in  the  bottom  section  of  Table  1. 
One  dataset  had  a  constant  c-parameter  value  of  .15  for  all  items  and  the  other 
had  randomly  generated  (normal  with  mean  .1,  standard  deviation  .1)  c-parameters 
for  the  50  items.  Results  for  these  datasets  were  not  quite  as  good  as  for  the 
datasets  having  zero  lower  asymptotes  as  can  be  seen  in  the  table. 

The  second  datset  was  analyzed  twice — once  with  the  c-parameters  fixed  to 
the  value  used  to  generate  the  data  for  each  item,  and  once  with  the  c-parame- 


ter  fi>ed  to  .1  for  each  item. 
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Results  from  analysis  of  one  dataset  consisting  of  2000  simulated  exami¬ 
nees  and  60  simulated  items  are  displayed  in  Tables  2  to  4.  The  dataset  was 
analyzed  twice  with  different  randomly  generated  starting  values  for  the  a- 
parameters . 

Table  2  shows  the  history  of  the  F  function  during  estimation  steps  and 
phases  for  one  run.  Note  that  two  very  small  negative  changes  occurred. 
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TABLE  1 

Correlational  Results  for  Simulated  Datasets 


Description  of  Dataset 


Correlations 


m 

ks& 


Datasets  fit  with  zero  c-parameter 


60 

.0 

.0 

.0 

60 

.0 

.0 

Second 

Set 

of 

Starting  Values 

2000 

60 

.0 

.3 

.2 

2000 

60 

.0 

.5 

.3 

2000 

60 

.2 

1  .0 

.0 

2000 

104 

.0 

.0 

.0 

915,  .909 
907,  .925 
924,  .908 

916.  .888 


907,  .885 
936,  .910 
913.  .886 


8,  .915 
3,  .853 
8.  .886 


0 

.0 

-.122 

(.822,  .1 

0 

.3 

-.338 

(.719,  .< 

0 

.5 

.052 

(.801,  . 

0 

.7 

-.144 

(.673,  .( 

2 

.0 

-.546 

(.619,  .. 

Datasets  fit  with  nonzero  c-parameter 


846,  .823 
855,  .830 
855.  .830 


o, 

.741 

.728 

9, 

.596 

1, 

.466 
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‘MIRTE  did  not  converge 

-parameter  varied  in  generation  and  fitting 
-parameter  varied  in  generation  but  set  to  .1  in  fitting 
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TABLE  2 


Dataset  1:  2000  Cases  and  60  Items 


History  of  Negative  Log  Likelihood  Function 


Phase 


-Ln(Like) 


54666.9 

52178.6 

51987.6 

51838.6 

51797.8 

51794.9 

51797.6 
50960.0 

50781.9 

50511.8 

49862.9 

48921.6 

48035.1 

47630.9 
47462.4 

47402.9 
47378.3 

47365.9 

47358.7 
47358.7 
47358.6 

47353.1 

47349.2 


2488.31 

190.97 

148.98 
40.82 

2.94 

-2.79 

837.70 

178.05 

270.09 

648.93 

941.26 

886.56 
404.14 

168.56 
59.45 
24.60 
12.43 

7.21 

-.04 

.13 

5.51 

3.90 
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Note!  If  Two  Successive  Phases  have  Changes  that  are  Within  +/-  the  Phase 
Criterion  (15.50)  of  zero,  the  Phase  is  Defined  to  be  Converged 

Execution  Halted  Because  Of: 

Maximum  Number  of  Steps  Reached 
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Tables  3  and  4  show  descriptive  statistics  on  the  proficiency  and  item  parame¬ 
ters,  respectively,  as  welL  as  statistics  on  the  estimates,  and  the  interrelations 
between  parameters  and  their  estimates.  Note  that  in  Table  3,  for  the  second  run, 
the  first  estimated  theta  dimension  relates  to  the  second  true  theta  dimension  and 
the  second  estimated  to  the  first  true.  There  is,  of  course,  no  way  the  program  can 
differentiate  one  dimension  from  another  in  the  order  in  which  they  are  derived. 

This  does  not,  however,  present  any  problem  for  interpretation  of  results  of  the 
analysis  of  real  data.  The  results  in  Table  3  show  that  the  program  does  ar  excel¬ 
lent  job  of  estimating  the  proficiency  dimensions  for  this  dataset. 

Table  4  shows  statistics  for  the  item  parameters  and  their  estimates  for  the 

generated  dataset  for  the  two  runs.  The  correlations  among  the  various  variables 

indicate  high  relationships  between  parameters  and  their  estimates.  Note  that, 
consistent  with  the  proficiency  estimates,  for  the  second  run  the  a^  parameter 
estimates  are  related  to  the  aj  parameters,  and  vice-versa.  The  table  shows  that 
the  program  also  does  an  excellent  job  of  estimating  the  item  parameters  for  this 
dataset . 

Although  every  attempt  has  been  made  to  ensure  that  the  program  works  correctly 
and  outputs  correct  results,  the  complexity  of  the  algorithm  makes  it  impossible  to 
guarantee  that  it  will  always  work  without  error.  Any  user  of  MIRTE  who  finds  an 

apparent  error  in  the  program  is  requested  to  report  it  to  ti*e  author. 
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TABLE  3 


Statistics  on  Generating  Proficiencies  &  MIRTE  Estimates 


Correlations 

First  Run  Second  Run 


Mean  St.  Dev. 
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Correlations 

First  Run  Second  Run 
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Chapter  2 


INPUT  TO  THE  PROGRAM 


The  dataset  to  be  analyzed  is  described  to  MIRTE  in  a  series  of  records 
described  below.  In  the  description,  records  containing  the  numeric  input 
(and  formats)  for  starting  values,  item  responses,  etc.,  are  referred  to  as 
"Data  Records"  in  order  to  distinguish  them  from  the  records  that  describe  the 
problem  run  to  the  program.  The  latter  are  referred  to  as  "Input  Description 
Records ." 

In  general  the  Input  Description  Records  can  be  in  any  order.  Most  of 
these  records  are  optional.  Each  begins  with  a  unique  Record  Name,  which  must 
begin  in  column  1.  The  ITEMS  Record  which  conveys  to  the  program  the  number 
of  items  ijs  required  and  must  precede  any  Data  Records .  An  INPUT  DATA  Record 
is  also  required  and  must  be  the  last  Input  Description  Record.  An  ITEM 
PARAMETERS  Record  is  also  required. 

In  order  to  allow  the  user  flexibility  in  labeling  a  problem  run,  any 
number  of  title  records  may  be  included  among  the  Input  Description  Records. 
The  program  assumes  that  any  record  that  it  does  not  recognize  as  a  Data 
Record  or  an  Input  Description  Record  is  a  title  record.  The  exact  contents 
of  these  records  are  printed  near  the  beginning  of  the  output.  As  a  result, 
misspelling  the  name  of  an  Input  Description  Record  will  cause  that  record  to 
be  treated  as  a  title  record. 

Each  Input  Description  Record  (except  title  records)  must  begin  with  its 
Record  Name  which  must  be  capitalized  and  begin  in  column  1^.  These  records 
contain  keywords  after  their  names.  Most  of  the  keywords  are  optional  and 
they  may  be  placed  in  any  order  on  the  record.  The  only  required  keyword  is 
that  specifying  the  number  of  items  (on  the  ITEMS  Record).  Keywords  must  be 
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capitalized  and  may  be  separated  either  by  blanks  or  commas .  Other  punctua¬ 
tion  on  the  Input  Description  Records  is  ignored  by  the  program  so  the  user 
may  include  additional  punctuation  as  separators  if  he/she  wishes  to  do  so. 

The  author  has  found  it  convenient  to  separate  Record  Names  from  keywords  with 
colons,  and  to  separate  keywords  from  each  other  with  both  a  comma  and  a 
blank.  The  reason  for  this  is  that  several  keywords  consist  of  two  words 
which  must  be  separated  by  blanks .  An  example  of  input  to  the  program  is 
provided  in  Figure  1  described  later. 


Input  Description  Records 


Each  record  is  described  below.  Item  Records  and  Keywords  with  asterisks  (*) 
are  required.  All  others  are  optional.  All  words  and  letters  must  be  capi¬ 
talized. 


Name  of  Record 


ITEMS 


Keywords 


FIXED 


PRINT  STEPS 


Comments 

Required:  There  is  no  default. 

#  is  the  number  of  items. 

No  blank  spaces  are  allowed  within 
this  keyword  (Example  N=35). 

Included  when  only  proficiencies  are  to  be 
estimated  from  fixed  input  parameters. 

If  included,  item  parameter  estimates 
are  printed  after  each  step  of  the 
estimation  process. 

If  it  is  not  included  only  the  starting 
values  and  final  estimates  are  printed. 
Must  contain  exactly  one  space  between 
PRINT  and  STEPS. 
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Name  of  Record 


Comments 


ITEMS  (continued 
from  previous 
page) 


SUBJECTS 


Keywords 


PRINT  FINAL 


FILE=# 


N=# 


FIXED 


PRINT  STEPS 


PRINT  FINAL 


-  Necessary  only  when  FIXED  is  specified 
and  the  user  wants  the  item  parameter 
estimates  printed  after  the  final  step. 

-  Requires  exactly  one  space  between  PRINT 
and  FINAL. 

-  Used  when  the  user  wishes  to  save  the 
final  parameter  estimates  in  a  file. 

-  Each  record  of  the  file  contains  the  M 
a-parameter  estimates,  followed  by  the 
d-parameter  estimate,  from  one  item. 

-  The  format  is  (1X,10F7.3). 

-  Output  defaults  to  unit  number  9  unless 
the  =#  Keyword  is  used  (=#  is  optional). 

-  #  is  the  optional  unit  number,  necessary 
if  9  not  to  be  used. 

-  No  blank  spaces  allowed  within  the 
keyword  (Example  FILE=11). 

-  Not  required:  By  default  MIRTE  counts 
the  number  of  subjects. 

-  #  is  the  number  of  subjects. 

-  No  blank  spaces  are  allowed  within  this 
keyword  (Example  N=2500). 

-  Included  when  only  item  parameters  are  to 
be  estimated  from  fixed  proficiencies. 

-  A  PROFICIENCIES  Record  is  required  when 
this  keyword  is  specified. 

-  If  included,  proficiency  estimates  are 
printed  after  each  step  of  the 
estimation  process  (Warning!  This  can 
generate  a  great  deal  of  output). 

-  No  proficiency  estimates  are  printed  by 
default . 

-  Requires  exactly  one  space  between  PRINT 
and  STEPS. 

-  If  included,  proficiency  estimates  are 
printed  after  the  final  step.  This  will 
generate  N  lines  of  output. 

-  No  proficiency  estimates  are  printed  by 
default . 

-  Requires  exactly  one  space  between  PRINT 
and  FINAL. 
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Name  of  Record 


SUBJECTS 
(continued 
from  previous 
page) 


RESIDUALS 


*INPUT  DATA 


Keywords 


Comments 


FILE=#  -  Used  when  the  user  wishes  to  save  the 

final  proficiency  estimates  in  a  file. 

-  Each  record  of  the  file  contains  the  M 
proficiency  estimates  for  one  subject. 

-  The  format  is  (1X,11F7.3). 

-  Output  defaults  to  Unit  Number  8  unless 
the  =#  Keyword  is  used  (=#  is  optional). 

-  #  is  the  optional  Unit  Number,  necessary 
if  8  not  to  be  used. 

-  No  blank  spaces  allowed  within  the 
keyword  (Example  FILE=1). 

FILE=#  -  If  this  keyword  is  specified  the 

residuals  are  output  to  a  file. 

-  Output  defaults  to  Unit  Number  11  unless 
the  =#  Keyword  is  used  (=#  is  optional). 

-  #  is  the  optional  unit  number,  necessary 
if  11  not  to  be  used. 

-  The  format  is  (1X,11F7.3). 

FULL  -  If  this  keyword  is  specified  the 

residual  variances  and  covariances  for 
each  item  are  printed. 

-  The  FULL  residual  analysis  is  not 
printed  in  the  output  unless  this 
keyword  is  specified.  A  summary  is 
always  printed. 

-  Exactly  one  space  required  between  INPUT 
and  DATA. 

-  Must  be  followed  by  the  item  response 
data  records  unless  the  data  are  in  a 
file  to  be  connected  at  run  time.  In 
that  case  a  UNIT=  Keyword  must  be 
specified. 

-  Item  response  data  must  consist  of  ones 
(correct)  and  zeros  (incorrect).  One  or 
more  records  per  subject,  controlled  by 
the  format. 

-  To  save  space,  item  response  data  are 
stored  by  MIRTE  as  CHARACTER* 1  data. 
Hence  the  format  must  contain  Al-fields, 
e.g.,  (40A1 ) . 
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Name  of  Record 


INPUT  DATA 
(continued  from 
previous  page) 


Keywords 


UNIT=# 


DEFAULT  FORMAT 


Comments 


If  the  user  supplies  a  format  it  must  be 
the  first  data  record  in  the  input 
response  data.  Hence  if  those  data 
follow  the  INPUT  DATA  Record  in  the 
primary  input  stream,  the  format  must  be 
immediately  after  that  Record.  If  the 
data  are  in  a  file  separate  from  the 
Input  Description  Records,  the  format 
must  also  be  in  that  separate  file  (and 
must  be  the  first  record  of  that  file). 

Used  to  specify  the  Unit  Number  of  the 
device  containing  the  item  response  data 
records,  i_f  those  records  are  not  in  the 
main  input  stream  along  with  the  INPUT 
DATA  and  other  Input  Description 
records . 

No  spaces  allowed  (e.g.,  UNIT=24). 

If  this  keyword  is  specified  there  may 
be  no  format  record  for  the  item 
response  data.  These  data  will  then  be 
read  by  the  format  (100A1). 

Requires  exactly  one  space  between 
DEFAULT  and  FORMAT. 
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STEPS 


MAXNUM=# 


CRI=# 


PHASES 


MAXIT=# 


CRI=.# 


Used  to  specify  the  maximum  number  of 
steps  if  the  default  of  4  is  not  to  be 
used . 

No  spaces  allowed  (e.g.,  MAXNUM=6). 

Used  to  specify  the  amount  of  change  in 
F  defining  convergence  of  phases.  Enter 
as  a  whole  number  or  with  a  decimal 
fraction. 

The  default  is  5. 

No  spaces  allowed  (e.g.,  CRI=35). 

Used  to  specify  the  maximum  allowed 
number  of  iterations  within  each  stage 
(for  both  item  parameter  estimation  and 
proficiency  estimation  iterations)  if 
the  default  of  16  is  not  to  be  used. 

No  spaces  allowed  (e.g.,  MAXIT=10). 

Used  to  specify  the  convergence 
criterion  for  all  iterations  within  each 
stage  if  the  default  of  .05  is  not  to  be 
used . 

Must  be  entered  with  a  decimal  point. 

No  spaces  allowed  (e.g.,  CRI=.01). 
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Name  of  Record 


PHASES 

(continued  from 
previous  page) 


Keywords 


CRI=.#  (cont.) 


LIMITS 


MAXNUM=# 


TMIN=# 


TMAX=# 


AMAX=# 


STARTA 


ITEM  PARAMETERS 


■•V-W-s' 


Comments 


When  an  item  parameter  estimate  or 
proficiency  estimate  changes  by  less 
than  CRI  in  any  iteration,  no  more 
iterations  are  performed  on  that 
estimate  during  that  phase.  The  program 
indicates  how  many  estimates  met  this 
criterion  for  each  phase. 

Used  to  specify  maximum  number  of  phases 
if  the  default  of  60  is  not  to  be  used. 
No  spaces  allowed  (e.g.,  MAXNUM=40). 

Used  to  specify  the  minimum  value  of 
each  proficiency  estimate  if  the  default 
of  -4.5  is  not  to  be  used. 

No  spaces  allowed  (e.g.  TMIN=-4). 

Used  to  specify  the  maximum  value  of 
each  proficiency  estimate  if  the  default 
of  4.5  is  not  to  be  used. 

Generally  TMAX  should  equal  -TMIN  but  it 
does  not  have  to  do  so. 

No  spaces  allowed  (e.g.,  TMAX=3.75). 

Used  to  specify  the  maximum  value  of 
each  a-parameter  estimate  if  the  default 
of  3.5  is  not  to  be  used. 

No  spaces  allowed  (e.g.,  AMAX=4.5). 

NB:  The  user  cannot  specify  a  minimum 
value  of  the  a- parameter  estimates. 

This  value  is  set  by  the  program  to  .01 
as  discussed  above. 

Used  to  instruct  the  prograr.  to  begin  by 
estimating  item  parameters  including  the 
a-parameter  at  step  1. 

Required  This  record  specifies  the 
nature  of  input  item  parameter-  or 
estimates. 

If  the  FIXED  Keyword  is  used  on  the 
ITEMS  Record  the  fixed  values  of  the 
item  parameters  are  input.  Otherwise 
starting  values  for  iterations  are 
input . 

If  the  FIXED  keyword  is  not  specified  on 
the  ITEMS  record,  no  d-parameter 
starting  values  are  input  unless  the 
SVDIF  keyword  is  specified. 

If  the  CPARM  VARIES  keyword  is 
specified,  the  c-values  are  input  with 
the  starting  values  of  the  item 
parameters . 
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Name  of  Record 


Keywords 


ITEM  PARAMETERS 
(continued  from 
previous  page) 


UNIT=# 


FREE  FORMAT 


SVDIF 


CPARM  VARIES 


Comments 


If  the  UNIT=#  keyword  is  used,  # 
specifies  the  unit  number  by  which  the 
file  containing  parameters  or  starting 
values  is  accessed.  If  no  unit  number 
is  specified,  these  values  are  on 
records  following  the  ITEM  PARAMETERS 
record. 

The  starting  values  (or  parameters)  for 
each  item  are  input  from  a  separate 
record,  the  M  a-parameter  values  first, 
followed  by  the  d-parameter  value,  and 
the  c-value  when  it  varies  from  item  to 
item. 

If  the  FREE  FORMAT  keyword  is  not 
specified,  a  record  containing  a  format 
statement  must  preceed  the  record  for 
the  first  item  parameter  values. 

Must  contain  exactly  one  space  between 
ITEM  and  PARAMETERS. 

Used  to  specify  the  unit  number  of  the 
device  containing  the  item  parameters 
data  records  (including  the  format 
record  if  one  is  used),  if  those  records 
are  not  in  the  main  input  stream  along 
with  the  ITEM  PARAMETERS  Record  and  the 
other  Input  Description  Records. 

No  spaces  allowed  (e.g.,  UNIT=21). 

Used  to  specify  that  free  format  input 
is  to  be  used  for  the  item  parameter 
data  records.  When  free  format  is  used 
those  data  records  must  have  blanks  or 
commas  between  the  different  parameters 
or  starting  values. 

Used  to  specify  that  starting  values  are  to 
be  input  for  the  difficulty  parameters.  By 
default  the  program  will  compute  starting 
values . 

Used  to  specify  that  the  c-constant 
varies  from  item  to  item.  When  this 
keyword  is  specified,  the  c-values  for 
each  item  are  input  along  with  the 
initial  a-parameters  or  estimates,  and 
initial  d-parameters  or  estimates  when 
they  are  input.  The  order  of  input  is 
as,  ds,  cs. 

Exactly  one  space  between  CPARM  and 
VARIES. 
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Name  of  Record 


Comments 


*ITEM  PARAMETERS 
(continued  from 
previous  page) 

PROFICIENCIES 


DIMENSIONS 


Keywords 


CPARM=#  -  Used  to  specify  the  common  value  of  the 

c-constant  when  it  does  not  vary  from 
item  to  item.  The  default  value  is 
zero . 

-  Used  when  FIXED  is  specified  on  the 

SUBJECTS  Record.  This  record  is  ignored 
otherwise . 

UNIT=#  -  Similar  to  that  specified  above  for  the 

ITEM  PARAMETERS  Record. 


FREE  FORMAT 


-  Similar  to  that  specified  above  for  the 
ITEM  PARAMETERS  Record. 


SVTHET 


ORTHO 


N=# 


-  Used  to  specify  that  start  values  are  to 
be  input  for  the  proficiency  estimates. 

By  default  the  program  will  compute  its 
own  starting  values.  Not  necessary  when 
the  FIXED  Keyword  is  used  on  the  SUBJECTS 
Record. 

-  Used  to  specify  that  the  starting  values 
for  the  proficiencies  are  to  be 
orthornormalized  before  estimation 
begins.  Should  not  be  used  when  the 
FIXED  Keyword  is  used  on  the  SUBJECTS 
Record. 

-  Only  required  if  the  number  of 
dimensions  is  not  2. 

-  Specified  the  number  of  dimensions  which 
defaults  to  2  if  this  keyword  is  not 
specified. 

-  Must  contain  no  spaces  (e.g.  N=3). 


Example  Input 


Figure  1  shows  an  example  input  for  a  run  of  the  MIRTE  program.  The 
first  two  lines  (records)  contain  no  Input  Record  Names  and  hence  are  title 
records  for  labeling  the  output.  The  DIMENSIONS  Record  specifies  a  two- 
dimensional  solution.  There  are  15  items  according  to  the  ITEMS  Record,  and 
item  parameter  estimates  are  to  be  saved  in  a  file  connected,  by  default,  via 
Unit  9.  The  proficiency  estimates,  are  specified  on  the  SUBJECTS  Record  to  be 
saved  in  a  file  connected  by  default  via  Unit  8.  The  final  proficiency 
estimates  are  also  to  be  printed  in  the  output  from  MIRTE.  The  maximum  number 
of  allowed  steps  is  specified  as  4  on  the  STEPS  Record  and  the  convergence 
criterion  for  steps  is  a  change  in  the  minimization  function,  F,  of  5.5  or 
less  in  two  consecutive  phases.  According  to  the  PHASES  Record  the  maximum 
total  number  of  phases  is  40  and  the  maximum  number  of  iteration  per  phase  is 
16.  The  criteria  for  convergence  of  estimates  is  a  .05  change  between  two 
consecutive  iterations.  The  maximum  allowed  a-parameter  estimate  is  specified 
on  the  LIMITS  Record  as  4.5.  According  to  the  RESIDUALS  Record,  residuals 
will  be  stored  in  a  file  connected,  by  default,  to  unit  11.  A  full  Residual 
Analysis  will  also  be  printed  out.  Although  there  is  a  PROFICIENCIES  Record 
in  the  input,  it  includes  no  keywords  and  hence  is  ignored  by  the  program. 

Start  value  data  records  follow  the  ITEM  PARAMETERS  Record  and  they  are  to  be 

read  in  free  format  from  Unit  Number  5.  Each  record  contains  the  initial 
estimates  of  al'  an<*  a2  ^or  an  *tero*  The  item  response  data  records  are  to  be 

input  with  the  Input  Description  Records  because  UNIT  Number  5  is  specified. 

The  data,  in  the  form  of  Is  and  Os,  complete  the  input  file. 
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(in  Deluujij  1  ny  Purpoiies 
DIMENSIONS:  N-2 
ITEMS:  N=  15,  FILE 
SUBJECTS:  FILE,  PR1NI  FINAL 
STEPS:  MAXNUM=4 ,  CRI-5.5 
PHASES:  MAXNUM-40,  MAX1T=16,  CR1-.05 
LIMITS:  AMAX -4 . 5 
RESIDUALS:  TILE,  FULL 
PROFICIENCIES: 

ITEM  PARAMETERS:  LIN  I  1=5,  FREE  FORMAT 


0.608 
1  . 924 
1  .671 
1.714 
0.004 
0 . 539 
0.085 
0.048 
1  .246 
1  .684 
1  . 297 
1  .676 
1  . 406 
l  .  730 
1.418 


1 . 399 
O  .  404 
0.338 
0.906 
1 .537 
1  .670 
1 . 458 
1 . 605 
0 . 458 
0.836 
t  .518 
1  .086 
0.602 
0.752 
0.000 


INPUT  DATA:  UNIT  5,  DEFAULT  FORMAT 

1 lOl 1 1 lOOl 1 1 lOl 

OlOl 1 1 10101 lOOl 

UOOtlOOlOOlOOl 

1 lOl 1 lOOOOOlOOl 

1 lOl 1 1 l 1 lOOl lOO 

1 10001001 lOOOOl 

lOOl 1 1 101001000 
1 1011 lOOl ioiooo 
1 lOlllOlllOlOOt 
OlOOl 1001000001 
OOOIOIOOI 101001 

1 1 1 1 1 oooooooooo 

l 101 1 1 101001001 

O 1 OOOOOOOO 1 1 ooo 

1  l  1  1  1 1 1 1 l 1 l 1000 
OOOl 1 t 101000000 
1 lOl 1 lOOl 1 1 lOOl 
OlOOl 1000100001 
1 101 1 lOOOl lOOOl 

1  101 1  loot  101001 


Figure  1.  Example-Input  (continued  next  page) 
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1 toi 1 101 t 1 1 1001 
O 1 ooooooooooooo 
1 101 10101001001 
1 lOl 1 1 101 1 11001 
1101110011110U 
010100000100001 
OOOl 1 100101 1001 
1 lOl 1 lOOl 1 10001 
1 1011 lOl 1 t lOOOl 
110000101111000 
OlOOl 1 lOl 101001 
1 1 lOl 1001 101001 
1 lOl 1 1 1 1 lOl lOOl 
111111111111101 
lllllllllOOHOl 
1 10101000001001 
1 lOOl lOOl 101001 
OIOOIOOOOOOIOOO 

i  ioi  noon  ioooi 

0101 1 100101 lOOl 
OlOOl OOOOOOOOOO 

i  iooioi  nooiooi 
O 1 OOO 1 OOO 1 ooooo 

1 100010001 IOOOI 
1 10101000100001 
oioioiooonoooi 
ooooo 1 ooooo lOOl 
loon  iooi  i  ioooi 
noioonnnooi 
i  loiooioionooi 


Figure  1.  (continued) 


Chapter  3 


EXAMPLE  OUTPUT 

The  output  generated  by  the  input  displayed  in  Figure  1  are  provided  in 
Appendix  B.  These  results  are  from  a  run  on  an  IBM  PC  AT  and  some  results 
will  differ  slightly  from  those  from  runs  on  a  mainframe  computer. 

Page  B2  of  Appendix  B  is  the  title  page  which  includes,  at  the  bottom, 
all  lines  from  the  input  file  that  are  not  recognized  by  the  program  as  being 
either  Input  Description  Records  or  Data  Records.  These  should  be  records 
intended  by  the  user  to  be  titles  for  the  output.  Note,  however,  that  any 
Input  Description  record  whose  name  is  misspelled  will  be  listed  here  and  not 
processed  by  the  program. 

The  third  page  of  the  appendix  lists  the  parameters  of  the  job,  including 
defaults  as  well  as  those  specified  by  the  user.  In  the  section  on  page  B4 
labeled  "initial  Item  Parameter  Estimates,"  the  estimated  values  of  d  were 
computed  by  the  program  using  the  method  described  in  Chapter  1.  The  esti¬ 
mated  values  of  the  a-parameters  are  those  input  by  the  user  (the  same  as 
those  in  Figure  1).  If  the  option  to  vary  the  c-parameter  over  items  is  used 
the  values  of  c  will  also  be  printed  here.  The  fourth  page  also  shows  the 
number  of  individuals  who  selected  the  correct  answer  to  each  item.  There  is 
also  an  indication  of  the  number,  if  any,  of  subjects  who  received  either  zero 
or  perfect  scores.  There  were  no  such  subjects  in  the  example  data,  but  when 
there  are  their  data  are  not  included  in  any  computations.  If  the  option  to 
print  proficiencies  is  selected  by  the  user  these  subjects  are  denoted  in  the 
output  file  as  having  zero  or  perfect  scores.  Finally,  the  initial  value  of 
the  negative  of  the  log  likelihood  (F)  is  printed. 

Pages  B5  through  Bll  show  the  output  provided  for  each  step  and  each 
phase  within  each  step.  The  user  may  also  have  estimates  output  at  each  step 
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but  this  considerably  increases  the  size  of  the  printout.  Page  B12  contains 
the  final  item  parameter  estimates  and  the  estimates  of  their  standard  er¬ 
rors.  Page  B13  shows  the  multidimensional  item  parameter  estimates.  The 
final  proficiency  estimates  and  their  standard  errors  are  displayed  on  pages 
B14  and  B15  and  the  latter  also  shows  the  correlation  between  the  estimated 
proficiency  (theta)  dimensions. 

Pages  B16  through  B20  illustrate  the  form  in  which  the  residual  variances 
and  covariances  are  printed  out  when  the  "FULL"  keyword  appears  on  the  "RESI¬ 
DUAL"  Input  Description  record.  The  residual  variance  for  each  item  and  the 
residual  covariances  with  the  estimated  proficiencies  (thetas)  are  printed 
first.  These  are  followed  by  the  values  of  the  residual  covariances  with  each 
of  the  other  items,  ordered  in  descending  order.  The  latter  have  been  found 
useful  in  detecting  items  that  violate  the  local  independence  assumption 
underlying  all  IRT  models.  When  items  that  violate  this  assumption  have  been 
generated  and  analyzed  with  a  set  of  independent  items  the  covariances  between 
the  dependent  items  have  tended  to  be  two  to  four  times  larger  than  those 
between  independent  items. 

Page  B21  contains  a  frequency  distribution  of  the  between-item  residual 
covariances.  This  table  is  always  printed,  even  when  "FULL"  is  not  specified 
on  the  RESIDUAL  Record.  Note  that  the  ranges  are  wider  in  the  second  half 
than  the  first  half  of  this  table.  The  final  page  of  the  output  shows  the 
history  of  the  negative  log  likelihood  function  over  all  the  steps  and  phases, 
and  the  reason  that  the  program  stopped  when  it  did.  In  the  example  it 
stopped  because  the  maximum  specified  number  of  steps  was  reached.  Note  that 
there  were  two  phases  in  which  the  changes  in  F  were  actually  negative.  Since 
the  magnitude  of  none  of  these  changes  exceeded  the  convergence  criterion  of 
5.5  (also  printed  on  this  page)  the  phases  at  which  they  occurred  were  de¬ 
clared  converged. 
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Appendix  A 

Partial  Derivatives  of  the  Negative  Log  Likelihood  Function 


First  Partial  Derivatives 
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Second  Partial  Derivatives 


32F  -  (P?. 

_L_  =  y  -ILL 

30?  A 

- jm  i=l 


-  c.x..)(P  •  ~  c.)Q..a. 

-1-11  -cj  -l  *11-1 


,  2  2 
(1  -  C.  P. . 
-1  -1 J 


(j  —  If  2 ,  • • • f  N5  m  —  If  2 ,  • • • f  M) 


MW  •>"  C  v« V 


*“C*r 

.  <r,  <_  -* 


MM  MM 
MMM  MMM 
MM  M  MM 
MM  MM 
MM  MM 


ULTIDIMENSIONAL 


I  1 1  I  I  I 

1  I 

I  I 

I I 

I I  I  I  I  I 


T  E  M 


RRRRRR 
RR  RR 
RRRRRR 
RR  RR 
RR  RR 


TTTTTTTT 

TT 

TT 

TT 

TT  H 


Two-parameter  Compensatory  Model 
Copyright  (c)  James  E.  Carlson 
ACT,  1988,  All  Rights  Reserved. 


EEEEEE 

EE 

EEEE 

EE 

EEEEEE  S 


I  M 


0  N 


Version  2.01 


MM  MM 
MMM  MMM 
MM  M  MM 
MM  MM 
MM  MM 


ULTIDIMENSIONAL 


I  I  I  I  I  I 
I  I 
I  I 
I  I 

I  I  I  I  I  I 


T  E  M 


RRRRRR 
RR  RR 
RRRRRR 
RR  RR 
RR  RR 


□  N 


TTTTTTTT 

TT 

TT 

TT 

TT  H 


Two-parameter  Compensatory  Model 
Copyright  <c)  James  E.  Carlson 
ACT,  19B8,  All  Rights  Reserved. 


Ver s i on  2.01 


EEEEEE 

EE 

EEEE 

EE 

EEEEEE  S  T  I  M  A  T  I  0  N 


m 


Of 


Small  Dataset,  NS=50,  NI=15 
For  Debugging  Purposes 


A 


Ai 


Jj 


At 


A 


Number  of  Subjects:  50 

Number  of  Items:  15 

Number  of  Dimensions:  £ 

Maximum  Number  of  Steps:  4 

Convergence  Criterion  for  Iterations:  0.050000 
Maximum  Number  of  Iterations:  16 

Convergence  Criterion  for  Steps:  5.50 


I  tern  Difficulty  Estimates  Constrained  Not  Less  Than:  -4.500 

and  Not  Greater  Than:  4.500 

Person  Proficiency  (Theta)  Estimates  Constrained  Not  Less  Than:  -4.500 

and  Not  Greater  Than:  4.500 

I  tern  Discrimination  Estimates  Constrained  Not  Less  Than:  0.010 

and  Not  Greater  Than:  4.500 

Common  c-parameter  of  ZERO  in  the  Model 
Discrimination  Start  Values  input  from  FILE  #  1 

I  tern  Parameter  Estimates  Output  to  FILE  #  9 

Proficiency  Estimates  Output  to  FILE  #  S 

Residuals  Output  to  FILE  #  11 

Final  Proficiency  Estimates  to  be  Output 

Full  Residual  Analysis  to  be  Output 

Both  Item  Parameters  and  Proficiencies  (Thetas)  will  be  Estimated 


B4 


Initial  Item  Parameter  Estimates 


I  tern 


1  .  101 

0.688 

1 .399 

3.605 

1 .924 

0.404 

2.481 

1.671 

0.338 

1.101 

1 .714 

0.906 

1 .333 

0.804 

1 .537 

1 .723 

0.539 

1 .678 

0.619 

0.885 

1  .458 

1 .497 

0.048 

1 .605 

1.101 

1 .246 

0.458 

0.479 

1 .684 

0.836 

0. 107 

1 .297 

1 .518 

0.991 

1  .676 

1  .086 

2.779 

1 .406 

0.602 

4 . 500m 

1 .730 

0.752 

1  .586 

1 .418 

0.000 

I 


Number  of  Subjects  =  50 


Number  Correct  Scores  for  Items 
I  terns  :  S  c  o  r 


Initial  Negative  Log  Likelihood:  0 . 3265B08 1 D+03 


Ceci 


Theta  Estimation:  Convergence  reached  for  49  Cases  in  16  Iteration(s) 
NUMBER  OF  PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  1 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  O . 3B65808 1 D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 2B774700D+03 

Difference:  0 . 38833B07D+02 


-Ln ( L i ke 1 i hood )  after  Rescaling: 


0.28787050D+03 


Phase  Not  Converged  by  Criterion  of:  +/-  5.5 

Step  Not  Converged:  Convergence  for  0  Successive  Phase(s) 

*********************  #***»****#♦»♦*#*#*****#**  ***#***#-**tt*******'***-tt-#**#-*#-**-***k, 

0 

v' 

V 

Start  of  Phase  #  2 

V 

y 

Item  Estimation:  Convergence  reached  for  14  items  in  16  Iteration(s)  «r 

NUMBER  OF  a-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  1  - 

NUMBER  OF  d-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX  =  1 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE  j 


t 


Last  Value  of  Negative  Log  Likelihood:  0 . 2G787050D-MD3 
New  Value  of  Negative  Log  Likelihood:  0 . 28874275D+03 

Difference:  -0 . 87225 1 9 1 D+00 


Phase  Converged  by  Criterion  of:  +/-  5.5 


Step  Not  Converged:  Convergence  for  1  Successive  Phase(s) 


Start  of  Phase  #  3  v*« 


Theta  Estimation:  Convergence  reached  for  49  Cases  in  16  Iteration(s) 


NUMBER  OF  PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  = 
MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 28874275D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 287552 1 4D  +  03 

Difference:  0 . 1 1 906 1 09D+0 1 


-Ln ( L i ke 1 l hood )  after  Rescaling: 


Phase  Converged  by  Criterion  of:  +/- 


0 . 28764 353D+03 


Step  Converged:  Two  Successive  Phases  Converged 


START  OF  STEP  #  2 


Estimating  Thetas  and  all  Item  Parameters 


****************************«-***********************************»*******-****-***\ 


Start  of  Phase  #  -  1 


I  tern  Estimation:  Convergence  reached  for  14  items  in  16  Iteration(s) 

NUMBER  OF  a-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  1 

NUMBER  OF  d-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX  -  1 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 2S764353D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 3655 1 269D+03 

Difference:  0 . 22 1 30835D+02 


Phase  Not  Converged  by  Criterion  of:  +/-  5.5 


Step  Not  Converged:  Convergence  for  C  Successive  Phase(s) 


******************************************************************************* 

Start  of  Phase  #  2 

Theta  Estimation:  Convergence  reached  for  48  Cases  in  16  Iteration(s) 

NUMBER  OF  PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  E 
MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . E655 1 E69D+03 

New  Value  of  Negative  Log  Likelihood:  0 . 24543282D+03 

Difference:  0 . 20079865D+02 


-Ln ( L i ke 1 i hood )  after  Rescaling: 


0.24590862D+03 


Phase  Not  Converged  by  Criterion  of:  +  /-  5.5 


Step  Not  Converged:  Convergence  far  0  Successive  Phase(s) 


Start  of  Phase  # 


Item  Estimation:  Convergence  reached  for  11  items  in  16  Iteration(s) 


NUMBER  OF  a-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  4 

NUMBER  OF  d-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX  =  1 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 24590862D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 23257787D+03 

Difference:  0 . 1 3330753D+02 


Phase  Not  Converged  by  Criterion  of:  +/-  5.5 


Step  Not  Converged:  Convergence  for  0  Successive  Phase(s) 


NUMBER  OF  PROFICI 
MAXIMUM  #  ITERATI 


******#*********************************************************.*****#.**.)<.*.***.)t>.i/ 

Start  of  Phase  #  6 

Theta  Estimation:  Convergence  reached  for  48  Cases  in  16  Iteration(s) 

NUMBER  OF  PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  2 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 220 1 4558D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 2 1 5597 1 7D+03 

Difference:  O . 45484 1 1 7D+0 1 


m 


-Ln ( L i ke 1 i hood )  after  Rescaling: 


0.21762704D+03 


Phase  Converged  by  Criterion  of:  +/-  5.5 


Step  Converged:  Two  Successive  Phases  Converged 


START  OF  STEP  #  3 

Estimating  Thetas  and  Difficulties  with  Fixed  Discriminations 


m 


*******♦****»*»**»*#**♦*******#**#****«#»**#***#****#*****#***#»*«*»**»******♦, 


Start  of  Phase  #  1 


Item  Estimation:  Convergence  reached  for  12  items  in  16  Iteration(s) 

NUMBER  OF  a-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  7 

NUMBER  OF  d-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX  =  3 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 2 1 762704D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 22046897D+03 

Difference:  -0 . 284 1 9365D+0 1 


Phase  Converged  by  Criterion  of:  +  /-  5.5 


Step  Not  Converged:  Convergence  for  1  Successive  Phase(s) 
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******************************************************************  ***********  *1. 

Start  of  Phase  #  2 

Theta  Estimation:  Convergence  reached  for  48  Cases  in  16  I  ter  ation(s) 

NUMBER  OF  PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  8 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


SS 


y 

& 

If 


Last  Value  of  Negative  Log  Likelihood:  0 . 22046897D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 2 1 770493D+03 

Difference:  O . 27640464D+0 1 


-Ln < L i ke 1 i hood )  after  Rescaling: 


0 . 2 1 936595D+03 


Phase  Converged  by  Criterion  of:  +/-  5.5 


Step  Converged:  Two  Successive  Phases  Converged 


START  OF  STEP  # 


Estimating  Thetas  and  all  Item  Parameters 


♦  **********(HHt**»*»»*»***»****iHHHHHHHH(-*»***#****#*******#**#***»*************t 


Start  of  Phase  #  1 


Item  Estimation:  Convergence  reached  for  6  items  in  16  Iteration(s) 

NUMBER  OF  a-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  9 

NUMBER  OF  d-PARAMETER  ESTIMATES  SET  TO  MIN.  OR  MAX  =  3 

MAXIMUM  #  ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood:  0 . 2 1 936595D+03 
New  Value  of  Negative  Log  Likelihood:  0 . 2 1 769968D+03 

Difference:  0 . 1 6662630D+0 3 


Phase  Converged  by  Criterion  of:  +/-  5.5 

Step  Not  Converged:  Convergence  for  1  Successive  Phase! 5 ) 


****************************************************************************** 


Theta  Est 
NUMBER  OF 
MAXIMUM  # 


Start  of  Phase  #  2 


imation:  Convergence  reached  for  47  Cases  in  16  Iteration(s) 
PROFICIENCY  ESTIMATES  SET  TO  MIN.  OR  MAX.  =  3 

ITERATIONS  REACHED  BEFORE  TOTAL  CONVERGENCE 


Last  Value  of  Negative  Log  Likelihood: 
New  Value  of  Negative  Log  Likelihood: 

D i f  f er  ence : 


0.21 76996BD+03 
0.2121631 3D+03 
0 . 553655 39 D+0 1 


-Ln ( L i ke 1 i hood  )  after  Rescaling: 


0.21 504503 D+0 3 


jC. 


If 

X 


X 


i 


Phase  Converged  by  Criterion  of:  +/-  5.5 


Step  Converged:  Two  Successive  Phases  Converged 


1 

1 .849 

0.516 

4 . 500* 

0.677 

4.500* 

0.655 

2 

2.122 

0.450 

0.909 

0.428 

0.143 

0.326 

3 

-3.063 

0.577 

0.064 

0.540 

1 .251 

0.370 

4 

0.811 

0.378 

1 .601 

0.445 

1 .924 

0.474 

5 

1  .986 

0.462 

0.010* 

0.484 

3.986 

0.872 

6 

1 .360 

0.382 

1.107 

0.407 

0.861 

0. 3B5 

7 

-1 .378 

0.463 

0.010* 

0.525 

4.500* 

1  .562 

a 

-4.500* 

0.583 

3.400c 

0.522 

4 . 500* 

0.633 

9 

1 .683 

0.487 

0.983 

0.581 

4.500* 

0.973 

10 

0.229 

0.428 

3.461 

0.845 

0.384 

0.380 

1 1 

-0 . 655 

0.344 

1 .764 

0.428 

0.718 

0.316 

12 

1  .088 

0.378 

0.010* 

0.404 

2.470 

0.691 

13 

-4.500* 

0.628 

2.429 

0.544 

3.801 

0.584 

14 

-4.500* 

0.573 

3.319 

0.493 

0.617 

0.533 

15 

2.843c 

0.578 

4.500* 

0.772 

1 .329c 

0.503 

m  Indicates  value 

set  to 

maximum  or 

mini  mum 

<  bef  or  i 

c 

* 


Indicates  estimate  did  not  converge 

Indicates  no  convergence  AND  set  to  maximum  or  minimum 


mi 


sssf 


m 
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I  tern 


MULTIDIMENSIONAL  ITEM  PARAMETER  ESTIMATES 


Dim.  2 


Gamma 

Beta 

A 1  phas 

MDISC) 

( MDIF ) 

( Ang 1 es ) 

6 . 364 

-0.291 

45.000 

45.000 

0.920 

-2.306 

8.908 

81 .092 

1 .253 

2.445 

87.064 

2.936 

2.504 

-0.324 

50.236 

39.764 

3.986 

-0.498 

89.852 

0. 148 

1 .403 

-0.970 

37.857 

52. 143 

4.500 

0.306 

89.869 

0.131 

5.640 

0.798 

52.928 

37.072 

4.606 

-0.365 

77.678 

12.322 

3.482 

-0.066 

6.333 

83.667 

1 . 905 

0.344 

22. 149 

67.851 

2.470 

-0.440 

89.761 

0.239 

4.511 

0.998 

57.419 

32.581 

3.376 

1 .333 

10.532 

79.468 

4.692 

-0.606 

16.448 

73.552 

•*  ll'f 


Case 


FINAL  THETA  AND  STANDARD  ERROR  ESTIMATES 


Dimension  1 


Th  1  S.E. 


Dimension  S 


Th  E  S.E 


55? 

Jm 

ISM 

I 

i, 


i 


0.  I7E 

0.E99 

-0.498 

0.237 

0.175 

0.389 

-0.040 

0.288 

2.41  1 

1 .226 

-0.150 

0.320 

1.130 

0.496 

-0.266 

0.294 

0.344 

0.E76 

0.017 

0.245 

2.012 

1.256 

-0.469 

0.356 

0.812 

0.319 

1 .518 

0.347 

0.EE7 

0.333 

-2.827 

03 

• 

»— t 

1 .527 

0.351 

-1 .655 

0.404 

1  .  1S5 

0.408 

-1.137 

0.365 

1 .361 

0.355 

-1 .901 

0.401 

0.343 

0.324 

-0.742 

0.333 

0.840 

0.535 

-0.210 

0 . 304 

1.111 

0.384 

0.279 

0.256 

0.146 

0.343 

0.243 

0.291 

Indicates  value  set  to  maximum  or  minimum  (before  rescaling) 
Indicates  estimate  did  not  converge 

Indicates  no  convergence  AND  set  to  maximum  or  minimum 
Indicates  PERFECT  No.  right  Score  for  this  Case 
Indicates  2ER0  No.  Right  Score  for  this  Case 


Correlations  Among  Theta  Estimates  (or  Thetas  when  Fixed) 


Theta(Ol)  Theta(OE) 


Theta ( 0 1 ) 


Theta ( 02 ) 


1 .000 


-0.395 


1  .000 


B16 


Variances  of  Residuals  for  Each  Item  &  Covariances  of  Residuals 
with  Theta  Estimates  (or  thetas)  S.  the  Other  Items 


Item  Number  1  :  Residual  Variance  =  0.069 

Covariances  with  Thetas:  0.011 

Residual  Covariances  (Item  #  :  Cov. ) 


0.003 


S: 

0.019 

3: 

0.017 

8: 

0.000 

13: 

-0.00E 

14: 

-0 . 005 

7: 

-0.009 

4: 

-0.009 

5: 

-0.010 

IE: 

-0.010 

10: 

-0.013 

9: 

-0.0S7 

6: 

-0.0E9 

1 1 : 

-0.031 

15: 

-0.033 

Item  Number  E  :  Residual  Variance  =  0.105 

Covariances  with  Thetas:  -0.0E3 

Residual  Covariances  (Item  #  :  Cov.) 


0.011 


1:  0.019  5:  0.014  3:  0.007  8:  0.005  IE: 

7:  0.003  10:  0.001  14:  0.000  13:  -0.00E  11: 

15:  -0.017  9:  -0.019  4:  -0.031  6:  -0.037 


0.004 

0.009 


U*l  » •  1  |'i  >.iu  (>■  |«^j 


At*.'***  Atm 


Item  Number  4  :  Residual  Variance  =  0.154 

Covariances  with  Thetas:  0.023  -0.033 

Residual  Covariances  (Item  #  :  Cov.) 


1  1  : 

0.024 

6: 

0.006 

13: 

0.005 

5: 

-0.001 

3: 

-0.003 

14: 

-0.003 

7: 

-0.007 

15: 

-0.00B 

1  : 

-0.009 

B: 

-0.013 

12: 

-0.013 

9: 

-0.027 

2: 

-0.031 

10: 

-0.033 

Item  Number  5  :  Residual  Variance  =  0.108 

Covariances  with  Thetas:  0.001  -0.017 

Residual  Covariances  (Item  #  :  Cov.) 

0.050  2:  0.014  15:  0.013  3:  0.007  13: 

0.002  4:  -0.001  14:  -0.002  1:  -0.010  B: 

-0.019  11:  -0.022  7:  -0.042  12:  -0.049 


0.003 

-0.011 


Item  Number  6  :  Residual  Variance  =  0.137 

Covariances  with  Thetas:  0.026 

Residual  Covariances  (Item  #  :  Cov.) 


-0.047 


0.050  15 

0.006  14 

-0.023  1 


0.013  9 

0.001  12 

-0.029  7 


0.012  10 

-0.004  3 

-0.032  2 


0.011  13: 
-0.008  8: 
-0.037 


0.009 

-0.019 


to 

m 


Item  Number 


7 


Residual  Variance 


0.060 


Covariances  with  Thetas:  -0.026  0.021 

Residual  Covariances  (Item  #  :  Cov. > 


1 1  : 

0.035 

10: 

0.010 

13: 

0.010 

14: 

0.004 

S: 

12: 

-0.001 

15: 

-0.002 

4  : 

-0.007 

8: 

-0.009 

1  : 

3: 

-0.009 

9: 

-0 . 009 

6 : 

-0.032 

5: 

-0.04S 

Item  Number  8  :  Residual  Variance  =  0.039 


Covariances  with  Thetas:  -0.0E0 


0.031 


Residual  Covariances  (Item  #  :  Cov.) 


9:  0.009 

15:  -0.00S 

5:  -0.011 


2 :  0 . 005 

IE:  -0.006 

4:  -0.013 


1 

7 

6 


0.000  3:  0.000 
-0.009  14:  -0.010 
-0.019  13:  -0.0E1 


10: 
1  1  : 


Item  Number  9  :  Residual  Variance  = 

Covariances  with  Thetas:  0.003 

Residual  Covariances  (Item  #  :  Cov.) 

0.0E1  6:  0.0  IS  B:  0.009  15 

0.000  IE:  -0.009  7:  -0.009  3 

-0.019  E:  -0.019  4:  -0.0E7  1 


0.073 


0.004 


0 . 008 
-0.011 
-0.0E7 


14  : 
13: 


0.003 

-0.009 


-0.001 

-0.011 


0.003 

-0.017 


Item  Number  10  :  Residual  Variance 


0.095 


Covariances  with  Thetas:  0.016  0.000 

Residual  Covariances  (Item  #  :  Cov.) 


0.031 

3: 

0.018 

6: 

0.011 

7  : 

0.010 

5: 

0.001 

14: 

0.001 

8: 

-0.001 

13  : 

-0.003 

13: 

0 . 009 

1  : 

-0.013 

4: 

-0.033 

15: 

-0.048 

Item  Number  11  :  Residual  Variance  =  0.171 


Covariances  with  Thetas: 


0.013  -0.003 


Residual  Covariances  (Item  #  :  Cov.) 


0.035  4 
0.005  10 
0.016  5 


0.034  13 
-0.009  3 
-0.033  6 


0.009  9: 
-0.009  13: 
-0.023  1: 


0.000  3: 
-0.010  8: 
-0.031 


Item  Number  13  :  Residual  Variance  =  0.131 


Covariances  with  Thetas: 


-0.032 


0.010 


Residual  Covariances  (Item  #  :  Cov.) 


0.01B  1 1 : 
-0.001  10: 
-0.010  1: 


0.009  15 
-0.003  6 
-0.010  4 


0.008  3 
-0.004  8 
-0.013  5 


0.004  13: 
-0.006  9: 
-0.049 


0.003 

-0.004 


-0.003 

-0.011 


0.003 

-0.009 


cu  o 


Item  Number  14  :  Residual  Variance  =  0.025 


Covariances  with  Thetas: 


-0. 106 


0.007 


Residual  Covariances  (Item  #  :  Cov.) 


0.01S 
0. 001 
-0.002 


0.004 

0.001 

-0.003 


0.003 

0.000 

-0.005 


0.002 

0.002 
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Distribution  of  Residual  Covariances 
Range  Frequency 


History  of 


-Ln < L i ke 1 i hood )  Function 


Step 

Phase 

-Ln (Like) 

Cnange 

0 

0 

0 . 32658 1 D+03 

1 

1 

0.287870D+03 

0 . 387 1 03D+02 

1 

2 

0.288743D+03 

-0 . 872252D+00 

1 

3 

0. 287644D+03 

0. 1 09922D+0 1 

2 

1 

0 . 2655 1 3D+03 

0 . 22 1 308D+02 

a 

2 

0.245909D+03 

0. 196041D+02 

a 

3 

0.232578D+03 

0. 13330BD+02 

a 

4 

0 . 22386 1 D+03 

0 . 87 1 649D+0 1 

a 

5 

0.220146D+03 

0 . 37 1 579D+0 1 

a 

6 

0 . 2 1 7627D+03 

0 . 25 1 855D+0 1 

3 

1 

0. 220469D+03 

-0.284194D+01 

3 

2 

0.21 9366D+03 

0. 1 1 0303D+0 1 

4 

1 

0.21 7700D+03 

0 . 166626D+01 

4 

2 

0.21 5045D+03 

0.265465D+01 

Note:  If  Two  Successive  Phases  have  Changes  that  are  Within  +  /-  the  Phase 
Criterion  (  5.50)  of  zero,  the  Phase  is  Defined  to  be  Converged 
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